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The purpose of this eross-seetional study was to measure imaging utilization rates and the 
negative appendectomy rate (NAR) in metropolitan Seoul, Korea. The study included 2321 
adolescents and adults (> 1 5 yr; median [interquartile range] age, 37 [27-50] yr; 46.7% 
female) undergoing appendectomy in 2011 at eight tertiary and three secondary hospitals. 
Imaging utilization rate was 99.7% (95% confidence interval, 99.4%-99.9%). CTand 
ultrasonography utilization rates as an initial imaging modality were 93.1% (92.0%- 
94. 1%), and 6.5% (5.6%-7.6%), respectively. The NAR in patients undergoing CT only, 
complementary ultrasonography following CT, ultrasonography only, and complementary 
CT following ultrasonography were 3.3% (2. 6%-4.1%), 27% (H%-44%), 9%(4%-16%), 
and 8% (2%-20%), respectively. The use of ultrasonography instead of CT as the initial 
imaging modality was significantly associated with higher NAR (adjusted odds ratio [AOR], 
2.28 [1 .22-4.27]; risk difference, 4.4 [0-8.8] percentage points), however, the population 
attributable risk was 0.3 [0-0.6] percentage points. We observed a very high CT utilization 
rate and a low NAR in metropolitan Seoul. Although the use of CT was significantly 
associated with the lower NAR, CT utilization rate already has reached the level that 
increase in CT utilization from the status quo would hardly decrease the NAR further. 
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INTRODUCTION 

Previous studies (1-7) consistently showed that increases in 
preoperative imaging utilization coincide with reductions in 
the negative appendectomy rate (NAR). The use of preoperative 
imaging in patients with suspected appendicitis is now accept- 
ed as the standard of practice in many developed countries. 
However, important questions still remain regarding how the 
imaging tests are being used and how they can be better used 
in practice. 

First, the generalizability of the previous studies is uncertain, 
mostly limited to single institutional studies conducted at lead- 
ing academic centers in the United States. Considerable region- 
al variations may exist in factors affecting imaging utilization 
patterns and the NAR, including reimbursement system, pa- 
tient body habitus, and incidences of alternative diagnoses (8- 
10). Second, although several experimental (11) and observa- 
tional (12, 13) studies as well as meta-analyses (14, 15) demon- 
strated that CT outperforms ultrasonography in terms of diag- 
nostic performance, there has been no study directly compar- 
ing CT and ultrasonography in terms of clinical outcomes such 
as NAR and appendiceal perforation rate. Third, there has been 
no study capturing an overview of current imaging utilization 
patterns, in how the choice of CT versus ultrasonography is made 



for the initial imaging test, how often complementary ultraso- 
nography (or CT) is needed following the initial CT (or ultraso- 
nography), and how the imaging tests at each of those steps af- 
fect clinical outcomes. Fourth, while powerful CT machines be- 
came widely available, studies have paid little attention to whe- 
ther new CT techniques have been truly disseminated through- 
out clinical practice. Modern CT technology has enabled un- 
precedentedly superb visualization of the appendix with excel- 
lent through-plane resolution and multiplanar capability (16). 
Attempts have been also made to lower the radiation dose (9). 

To this end, we investigated imaging utilization rates and the 
NAR in 201 1 in metropolitan Seoul, Korea. 

MATERIALS AND METHODS 

This multi-institutional cross-sectional study was conducted by 
the Low-dOse CT Appendicitis Trial (LOCAT) group (Appen- 
dix) (17). The study included adolescents and adults undergo- 
ing non-incidental appendectomy in 2011 at 11 hospitals in 
metropolitan Seoul. Data were collected from medical records 
as well as from questionnaires and interviews of site investiga- 
tors by two study coordinators in conjunction with site investi- 
gators from November 2012 through April 2013. 
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Investigating sites 

The LOCAT Office invited all members of the Korean Society of 
Abdominal Radiology (a nationwide society of abdominal radi- 
ologists) from 119 hospitals (including 67 in metropolitan Seoul 
[Seoul and Gyeonggi]) to participate in this study. Finally, eight 
tertiary and three secondary hospitals with a median bed num- 
ber of 800 (range, 554-1,950) participated in the study (Appen- 
dix Fig. 1, Appendix Table 1). All hospitals were located in met- 
ropolitan Seoul, and accounted for 18% of the 63 hospitals hav- 
ing 300 or more beds in metropolitan Seoul (18) where 40,000 
appendectomies are performed annually from a total popula- 
tion of 21 million (19). 

Patients 

We included patients with 15 yr of age or older who visited the 
site emergency departments and then underwent non-inciden- 
tal appendectomies from January through December 201 1. The 
site investigators initially searched hospital information systems 
to identify patients who visited the emergency departments and 



then underwent appendectomy, cecectomy, or ileocecectomy. 
In this study, cecectomy and ileocecectomy as well as simple 
appendectomy performed for the treatment of presumptive ap- 
pendicitis were collectively termed non-incidental appendec- 
tomy. Through medical record review, the study coordinators 
then excluded cases of incidental appendectomy, age under 15 
yr, or pregnant women (Fig. 1). 

Patterns of patient care and imaging protocols 

The study coordinators gathered the information using ques- 
tionnaires and through interviews with site investigators (Ap- 
pendix). 

Imaging utilization rates 

The analysis included all imaging examinations performed at 
the sites or at outside hospitals before the patient transfer to the 
site emergency departments. The imaging utilization rate was 
defined as the percentage of any preoperative cross-sectional 
imaging utilization in all non-incidental appendectomies (1, 3, 



119 hospitals invited to the study | 






11 hospitals participated 







3,023 visited emergency departments 
and then underwent appendectomy 



702 excluded 

• 154 incidental appendectomies 

• 528 under age 15 years 

• 20 pregnant 



I 



2,160 underwent iCT* 
NAR: 3.7% (80/2,159) 
APR: 32.1% (667/2,079) 
Sensitivity of iCT: 96.4% 
(1,906/1,977) 

I 



2,123 underwent iCTonly" 

NAR: 3.3% (70/2,122) 
APR: 32.4% (665/2,052) 
Sensitivity of iCT: 96.6% 
(1,883/1,950) 



2,321 finally included* 
NAR: 4.1% (94/2,320) 
APR: 31.9% (710/2,226) 



152 underwent iUS 
NAR: 9% (13/152) 
APR: 29% (40/139) 
Sensitivity of iUS: 100% (76/76) 



112 underwent iUS only 
NAR: 9% (10/112) 
APR: 27% (28/102) 
Sensitivity of iUS: 100% (65/65) 



6 underwent no 
imaging test 
NAR: 0% (0/6) 
APR: 50% (3/6) 



3 underwent both imaging tests 1 " 
NAR: 33% (1/3) 
APR: 0% (0/2) 



37 underwent cUS 
NAR: 27% (10/37) 
APR: 7% (2/27) 
Sensitivity of iCT: 85% (23/27) 
Sensitivity of cUS: 88% (22/25) 



40 underwent cCT 
NAR: 8% (3/40) 

APR: 32% (12/37) 
Sensitivity of iUS: 100% (11/11) 
Sensitivity of cCT: 89% (31/35) 



Fig. 1 . Study flow diagram. APR indicates appendiceal perforation rate; cCT, complementary computed tomography; cUS, complementary ultrasonography; iCT, initial computed 
tomography; iUS, initial ultrasonography; NAR, negative appendectomy rate. Cases with unavailable computed tomography (n = 1 06) or ultrasonography (n = 67) reports were 
not included when calculating the sensitivities. When calculating the sensitivities, indeterminate results were counted as a positive diagnosis. 'Includes one patient with a miss- 
ing pathology report; The order of the two imaging tests was unclear. 
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5, 20). CT utilization rate was defined as the percentage of CT 
utilization as the initial imaging modality for all non-incidental 
appendectomies. Similarly, ultrasonography utilization rate was 
measured. Our definition of CT (or ultrasonography) utilization 
rate may be different from those in previous studies (2-4) which 
are likely to have included complementary CT (or ultrasonog- 
raphy) following initial ultrasonography (or CT). 

Negative appendectomy rate (NAR) 

NAR was defined as the percentage of uninflamed appendices 
in all non-incidental appendectomies (9). The study coordina- 
tors determined the presence of appendicitis based on clear 
documentation of appendicitis or neutrophil infiltration in the 
appendiceal wall (21) in pathology reports. If neutrophilic col- 
lection was confined to the mucosa, the diagnosis was based 
on the documentation of mucosal ulcerations (22). Cases in- 
volving interval appendectomies were counted as cases of ap- 
pendicitis even if such pathologic documentation was not pres- 
ent. Cases involving appendiceal diverticulitis were also count- 
ed as cases of appendicitis since the distinction between the 
two diseases is not clinically important and the two diseases 
commonly coexist (23, 24). 

Appendiceal perforation rate 

Appendiceal perforation rate was defined as the percentage of 
perforations in all confirmed appendicitis (2, 6, 9, 25). The study 
coordinators determined the presence of perforation based on 
spillage of the appendiceal contents, peritonitis, or abscess doc- 
umented in surgical records; or appendiceal wall defect from 
transmural necrosis documented in pathologic reports (9). Even 
if such documentation was not present, cases undergoing in- 
terval appendectomies following percutaneous drainage pro- 
cedures for periappendiceal abscesses were counted as perfo- 
rations. 

Diagnostic sensitivities of imaging modalities 

At least 12 weeks after reviewing the pathologic reports and sur- 
gical records, the study coordinators categorized all available 
CT and ultrasonography reports by using a 3-point scale (grade 
1, absent; grade 2, indeterminate; or grade 3, present) for the 
diagnosis of appendicitis (Appendix Table 2). The diagnostic 
sensitivity was defined as the percentage of positive test results 
of confirmed appendicitis with two different thresholds: grades 
> 2 and only grade 3, as positive. We did not calculate diagnos- 
tic specificity, positive predictive value, or negative predictive 
value as our sample included only patients who underwent ap- 
pendectomy. 

Statistical analysis 

The number of cases at the participating sites during the study 
period determined the sample size. All analyses were pre-plann- 



ed, except for the test for the interaction and the effect on the 
study population NAR. Univariable and multivariable subgroup 
analyses were performed by using logistic regression models 
involving generalized estimating equations to account for clus- 
tering effect by site. In the univariable subgroup analyses, we 
tested patient demographics, body mass index, time of presen- 
tation in the emergency department, the use of CT versus ultra- 
sonography as the initial imaging modality, times needed for 
patient dispositions, mode of surgical approach, and site annu- 
al appendectomy volume. For multivariable models, covariates 
were selected by considering the potential causality and collin- 
earity in a clinical context. Missing data were not included in 
the analysis. P values less than 0.05 were considered statistically 
significant. All statistical analyses were performed using STATA 
version 12.1 (StataCorp, College Station, TX, USA). 

Ethics statement 

The institutional review boards at all investigating sites approved 
the study and waived the requirement for informed consent. 
(IRB No. KUGH12252-001; AS12192; 13-009; B-1301/188-113; 
DR13-01; SMC 2013-02-009-001; SCHBC_IRB_2013-11; 2013- 
009; 2013-02-07; 2013-1024; HYUH 2013-02-002-003) 

RESULTS 

Patient characteristics 

During the study period, 3,023 patients visited the site emer- 
gency departments and underwent appendectomy. This num- 
ber accounted for 7.6% of total appendectomies in metropoli- 
tan Seoul during the same period (19). After excluding 702 pa- 
tients according to the aforementioned criteria, 2,321 patients 
(46.7% female; median [interquartile range, IQR] age, 37 [27-50] 
yr) were included (Fig. 1, Table 1). Of these patients, 323 had 
been included in other studies (9, 26). In 35 cases with original 
pathology reports inconclusive for the presence of appendicitis, 
site pathologists re-examined the primary tissue sections. Ap- 
pendicitis was confirmed in 2,226 patients, including 49 with 
appendiceal diverticulitis and 13 with appendiceal neoplasms 
complicated with appendicitis. One case missing the pathology 
report was not included in some subsequent analyses. 

Pattern of patient care 

The typical pattern of patient care at the sites is described in Ap- 
pendix, including the number of doctors involved in the patient 
care (Appendix Table 3). Although the practice pattern was not 
uniform across the sites, the variations were deemed minor. 

CT imaging protocols 

Intravenous contrast-enhanced CT examinations of the abdo- 
men and pelvis were performed using 8- or more detector-row 
machines. No site had any CT order or automated scan program 
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Table 1 . Patient characteristics 



Characteristics 


Patients (n = 2,321) 


Age (yr) 
Median (IQR) 
15-44, No. (%) 
> 45, No. (%) 


37 (27-50) 
1,513(65.2) 
808 (34.8) 


Female, No. (%) 


1 ,083 (46.7) 


Reproductive female, No. (%)* 


690 (29.7) 


Body mass index (kg/m 2 )* 

IVIGUIal I ^lUnj 

Underweight ( < 1 8.5), No. (%) 
Normal (18.5-24.9), No. (%) 
Overweight (25.0-29.9), No. (%) 
Obesity ( > 30.0), No. (%) 
Missing, No. (%) 


22 8 (?f) fi-25 n\ 

C-C..O ^lU.U L.O.KJ) 

170(7.3) 
1,540(66.4) 
496 (21 .4) 
86 (3.7) 
29 (1 .2) 


Time of presentation in emergency department 
Working hours, No. (%)* 
After hours, No. (%) 


767 (33) 
1,554(67.0) 


Timp tn annpnrlprtnmw (hri§'^ 
i ii i ic lu u|j[jbi iucului i iy \ \ ii ) 

Median (IQR) 
< 6, No. (%) 
6-12,No.(%) 
>12,No.(%) 


6.6(4.3-11.6) 
1,035(45.0) 
740 (32.2) 
523 (22.8) 


Mode of surgical approach 
Laparoscopy, No. (%) 
Open, No. (%) 
Conversion, No. (%) 


1 ,567 (67.5) 
721 (31.1) 
33 (1 .4) 


Time to discharge (d)" 1 ' 
Median (IQR) 
< 4, No. (%) 
> 4, No. (%) 


3.8 (2.9-5.4) 
1 ,238 (53.9) 
1,060(46.1) 



1 5-44 yr; height in kilograms divided by the square of height in meters; *8:00 AM 
to 5:00 PM on working days; § Defined as the interval from the emergency depart- 
ment visit to the induction of anesthesia for appendectomy; "Defined as the interval 
from the emergency department visit until hospital discharge; 'Does not include 23 
cases of interval appendectomy. IQR, interquartile range. 



dedicated to appendicitis imaging. Ten sites acquired precon- 
trast and/or arterial phase scans in addition to a portal venous 
phase scan. All sites used fixed tube potentials: 120 kVp at 10 
sites and 100 kVp at one site. One site did not use automatic 
tube current modulation for all patients and two sites used iter- 
ative reconstructions. Image thicknesses for primary interpre- 
tation ranged from 3 mm to 5 mm. Only one site used overlap- 
ping image reconstruction. Nine sites reconstructed additional 
thin ( < 2 mm) sections. All sites used additional coronal refor- 
mation. According to the site investigators' responses to the ques- 
tionnaire, the typical effective dose of the CT radiation for an 
average-sized patient varied widely, 8 mSv at one site, exceeding 
10 mSv at 10 sites and exceeding 20 mSv at two sites (Table 2). 

Imaging utilization rates 

Imaging utilization rate was 99.7% (95% confidence interval 
[CI], 99.4%-99.9%; 2,315/2,321). CT was the initial imaging mo- 
dality for 2,160 patients (CT utilization rate, 93.1% [95% CI, 92.0%- 
94.1%]), 37 (1.7% [95% CI, 1.2%-2.4%]) of whom underwent 
subsequent complementary ultrasonography. Ultrasonography 
was the initial imaging modality for 152 patients (ultrasonogra- 



Table 2. CT imaging protocols 



Imaging parameters 


Sites (n = 11) 


Mi imhor nf Hotoptnr rrnfl/c 
NUIMUcI Ul UcLcuLUI lUWb 

Q 


i 


o 

1 6 




64 


4 


16 or 64 


4 


16,64, or 256 


1 


Mi imhpr nf nnntracit-pnhannpmpnt nhflQPQ 

l>IUIIIUGI Ul UUIItlQoL CI 1 1 I Cll IUCI I ICI 1 1 Ul lUOCo 




1 fPnrtal upnniic; nnKA 

i \r ui Lai vci luua ui ny^ 


-| 


2 (Precontrast and portal vonous) 


6 


3 (Precontrast, arterial, and portal venous) 


2 


1 or 2* 


2 


Tube potential (kVp) 




100 


1 


120 


10 


Ai ifnmatir ti ihp n irrpnt mnrii ilatinn 

MULUI 1 laLIU LUUG UUI 1 CI IL 1 1 1 UU U 1 CI LI Ul 1 




Used 


10 


Partly i iqpH* 

r ai Liy uocu 


1 


Iterative reconstruction 




Used 




Partly used* 


1 


Not i i^pd 

I^UL UOCU 


g 


TranwprQP imanp rprnn^tn irtinn thinknpQQ frnrrA 
1 1 ai lovci oc niiayc i cuui ioli uuliui i tinurMicoo ^iiiiiij 




3 


-| 


3.75 




5 


7 


3 or 5 f 


1 


4 or 5* 


1 


Rprnn^tn irtinn nwprlfln (%\ 

1 1GUUI loll UULIUI 1 UVUI ICl[J \ <0) 




None 


10 


on nr 9^* 
ilU Ul tLO 


i 


Additional transverse thin section ( < 2 mm) reconstruction 




Used 


9 


Not used 


2 


Typical effective dose (mSv) 




<10 


1 


< 10 or 10-20* 


2 


10-20 


6 


>20 


2 



No site had any CT order or automated scan program dedicated to appendicitis im- 
aging. All sites used intravenous contrast agents. No site used oral or rectal contrast 
agent. The scan range covered the entire abdomen and pelvis at all sites. All sites 
used additional coronal reformation. 'Varied with machine within a site; + Varied with 
contrast-enhancement phase within a CT examination. CT, computed tomography. 



phy utilization rate, 6.5% [95% CI, 5.6%-7.6%]), 40 (26.3% [95% 
CI, 19.5%-34.1%]) of whom underwent subsequent comple- 
mentary CT. In three of the patients who underwent both CT 
and ultrasonography at outside hospitals, the order of the two 
imaging examinations was unclear. No patient underwent mag- 
netic resonance imaging. Imaging utilization rates for individu- 
al sites and imaging utilization rate adjusted for clustering by 
site are available in Appendix Table 4. In 238 patients, 214 CT 
and 31 ultrasonography examinations were performed at out- 
side hospitals (Appendix Table 5). 

As virtually all patients underwent CT or ultrasonography, 
the subgroup analysis results are presented only for ultrasonog- 
raphy utilization rates. Only small differences were observed 
between subgroups. Relatively higher ultrasonography usage 
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Table 3. Subgroup analysis for the ultrasonography utilization rate 



Variables 


Ultrasonography utilization rate, 
% (95% CI) [Numerator/Denominator]* 


Univariate analysis, 
OR (95% CI) 


Multivariate analysis, 
AOR (95% CI) 


Aqe (yr) 
15-44 
>45 


7.3 (6.1-8.8) [111/1,513] 
5.1 (3.7-6.8) [41/808] 


1.49 (1.01-2.18) 
1 (Reference) 


1.54 (1.04-2.27) 
1 (Reference) 


Sex 
Male 
Female 


5.3 (4.1 -6.6) [65/1 ,238] 
8.0 (6.5-9.8) [87/1 ,083] 


1 (Reference) 
1.62 (1.14-2.29) 


1 (Reference) 
1.60 (1.12-2.27) 


Rpnrnrli irtk/p fpmplp 

1CUI UU U L, LI V Lj IGIIIQIG 

Female 15-44 yr 
Others 


9.3 (7.2-11.7) [64/690] 
5.4 (4.3-6.6) [88/1 ,631] 


1 .85 (1 .30-2.64) 
1 (Reference) 




Rniiv ma^ inrlpv fkn/m^ T 

Underweight ( < 18.5) 
Normal (18.5-24.9) 
Overweight (25.0-29.9) 
Obesity ( > 30.0) 
Missing 


11 (6-16) [18/170] 

6.7 (5.5-8.1) [103/1 ,540] 

4.8 (3.1-7.1) [24/496] 
5 (1-11) [4/86] 

10 (2-27) [3/29] 


1 .65 (0.96-2.84) 
1 (Reference) 
0.70(0.44-1.13) 
0.64(0.22-1.89) 
NA 


1.46 (0.85-2.51) 
1 (Reference) 
0.82 (0.51-1.32) 
0.66 (0.23-1.89) 
NA 


Time of presentation in emergency department 
Working hours* 
After hours 


10.7 (8.6-13.1) [82/767] 
4.5 (3.5-5.7) [70/1 ,554] 


2.47 (1 .75-3.50) 
1 (Reference) 


2.54 (1.79-3.61) 
1 (Reference) 


Time to appendectomy (hr) §1 
<6 
6-12 

212 


8.5 (6.9-10.4) [88/1,035] 
5.4 (3.9-7.3) [40/740] 
4.4 (2.8-6.5) [23/523] 


1 (Reference) 
0.63 (0.42-0.94) 
0.56 (0.35-0.90) 




Mode of surgical approach 
Laparoscopy 
Open 

Conversion 


5.2 (4.2-6.5) [82/1 ,567] 
9.3 (7.3-11.7) [67/721] 
9 (2-24) [3/33] 


1 (Reference) 
1 .52 (1 .02-2.26) 
1 .82 (0.56-5.96) 




Time to discharge (d)" 
<4 
>4 


6.6 (5.3-8.2) [82/1 ,238] 
6.5 (5.1 -8.2) [69/1 ,060] 


1.12(0.79-1.59) 
1 (Reference) 




Site annual appendectomy volume** 
<240 
>240 


5.1 (3.9-6.5) [57/1,120] 
7.9 (6.4-9.6) [95/1,201] 


1 (Reference) 
1 .42 (0.82-2.43) 


1 (Reference) 
1.30 (0.78-2.16) 



Numerators do not include three patients who underwent both CT and ultrasonography where the order of imaging was unclear. Ellipsis indicates that the variable was not test- 
ed in the multivariable analysis. 'Defined as the percentage of ultrasonography utilization for an initial imaging test of all non-incidental appendectomies; f Weight in kilograms 
divided by the square of the height in meters; *8:00 AM to 5:00 PM on working days; § Defined as the interval from the emergency department visit to the induction of anesthe- 
sia for appendectomy; "Defined as the interval from the emergency department visit until hospital discharge; 'Does not include 23 cases of interval appendectomy; "Number of 
patients included in the study. AOR, adjusted odds ratio; CI, confidence interval; NA, not applicable; OR, odds ratio. 



was associated with younger age, female gender, presentation 
during working hours, and open surgery in the univariable anal- 
ysis; and with younger age (adjusted odds ratio [AOR], 1.54; 95% 
CI, 1.04-2.27; P = 0.029), female gender (AOR, 1.60; 95% CI, 1.12- 
2.27; P = 0.009), and presentation during working hours (AOR, 
2.54; 95% CI, 1.79-3.61; P < 0.001) in the multivariable analysis 
(Table 3). 

NAR 

The overall NAR was 4.1% (95% CI, 3.3%-4.9%; 94/2,320). If 15 
cases of appendiceal neoplasms without appendicitis were ex- 
cluded from the negative appendectomies, the NAR would de- 
crease to 3.4% (95% CI, 2.7%-4.2%). NARs for individual sites 
and the overall NAR adjusted for clustering by site are available 
in Appendix Table 6. The NAR in patients who underwent CT 
only was 3.3% (95% CI, 2.6%-4.1%). Higher NARs were observed 
in patients who underwent ultrasonography only (9% [95% CI, 
4%-16%]) as well as in patients who required complementary 



ultrasonography following initial CT (27% [95% CI, 14%-44%]) 
or complementary CT following initial ultrasonography (8% 
[95% CI, 2%-20%]) (Fig. 1). 

Only small differences in NAR were observed between sub- 
groups. In the univariable analysis, higher NARs were associat- 
ed with the use of ultrasonography as the initial imaging mo- 
dality and with longer hospitalization. Although not statistically 
significant, underweight patients tended to have more negative 
appendectomies. In the multivariable analysis, the use of ultra- 
sonography instead of CT as the initial imaging modality was 
significantly associated with the higher NAR (AOR, 2.28; 95% 
CI, 1.22-4.27; P = 0.010) (Table 4). No significant interaction was 
observed between the use of initial ultrasonography and other 
factors. 

Effect of the initial imaging modality on the population 
NAR 

From the AOR, we estimated the effect (27). If ultrasonography 
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Table 4. Subgroup analysis for the negative appendectomy rate and appendiceal perforation rate 





Negative appendectomy rate 


Appendiceal perforation rate 




Variable 


Percentage, % (95% CI) Univariate analysis, Multivariate analy- 
[Numerator/Denominator]* OR (95% CI) sis, AOR (95% CI) 


Percentage, % (95% CI) Univariate analysis, 
[Numerator/Denominator]* OR (95% CI) 


Multivariate analy- 
sis, AOR (95% CI) 



Age (yr) 

15-44 

>45 
Sex 

Male 

Female 
Reproductive female 

Female 1 5-44 yr 

Others 
Body mass index (kg/m 2 )* 

Underweight ( < 18.5) 

Normal (18.5-24.9) 

Overweight (25.0-29.9) 

Obesity ( > 30.0) 

Missing 



4.3 (3.3-5.4) 
3.6(2.4-5.1) 

4.0 (2.9-5.2) 
4.2 (3.0-5.5) 

4.6 (3.2-6.5) 
3.8 (2.9-4.8) 

7(4-12) 
3.8 (2.9-4.8) 
3.6 (2.2-5.7) 
6(2-13) 
3(0-18) 



Time of presentation in emergency department 

Working hours* 5.1 (3.6-6.9) 

After hours 3.5 (2.7-4.6) 

Initial imaging test 

CT 3.7 (2.9-4.6) 

Ultrasonography 9(5-14) 

None 0 (0-46) 

Unclear 33(0-91) 

Time to appendectomy (hr) 51 



65/1,512] 
29/808] 

49/1,238] 
45/1 ,082] 

32/689] 
62/1,631] 

12/170] 
58/1 ,539] 
18/496] 
5/86] 
1/29] 

39/767] 
55/1 ,553] 

80/2,159] 
13/152] 
0/6] 
1/3] 



1.21 (0.77-1.90) 
1 (Reference) 

1 (Reference) 
1.05(0.70-1.60) 

1.24(0.80-1.92) 
1 (Reference) 

1.94 (1.02-3.70) 
1 (Reference) 
0.96 (0.56-1.65) 
1.57(0.61-4.03) 
NA 

1.45 (0.95-2.21) 
1 (Reference) 

1 (Reference) 
2.42 (1.31-4.48) 
NA 
NA 



1.15(0.73-1.83) 
1 (Reference) 

1 (Reference) 
1.03(0.67-1.58) 



1 .81 (0.94-3.48) 
1 (Reference) 
1.01 (0.58-1.75) 
1.61 (0.62-4.13) 
NA 

1.42(0.92-2.19) 
1 (Reference) 

1 (Reference) 
2.28 (1.22-4.27) 
NA 
NA 



25.2 (22.9-27.5] 
44.4 (40.9-48.0] 

34.6 (31 .9-37.3 

28.8 (26.1-31.7 

23.1 (20.0-26.6] 

35.6 (33.2-38.0 

29 (22-37; 

30.9 (28.6-33.3; 

34.7 (30.5-39.2; 
32 (22-43 
50(31-69; 

37.0 (33.4-40.6; 
29.4 (27.1-31.8; 

32.1 (30.1-34.1 
29 (21-37; 
50 (12-88; 
0 (0.0-84 



<6 


3.4 (2.4-4.7) 


[35/1 ,034] 


1 (Reference) 




32.6 (29.7-35.6) 


[326/999] 


1 (Reference) 


1 (Reference) 


6-12 


3.9 (2.6-5.6) 


[29/740] 


1.17(0.70-1.96) 




31.1 (27.7-34.6) 


[221/711] 


0.96(0.78-1.19) 


0.95 (0.76-1.18) 


> 12 


5.7(3.9-8.1) 


[30/523] 


1.83 (1.09-3.08) 




28.4 (24.5-32.6) 


[140/493] 


0.89(0.70-1.13) 


0.95 (0.73-1 .22) 


Mode of surgical approach 


















Laparoscopy 


4.0(3.1-5.1) 


[63/1 ,566] 


1 (Reference) 




28.6 (26.3-31.0) 


[430/1 ,503] 


1 (Reference) 




Open 


3.9 (2.6-5.6) 


[28/721] 


0.90 (0.54-1.50) 




37.1 (33.5-40.8) 


[257/693] 


1.50 (1.19-1.89) 




Conversion 


9 (2-24) 


[3/33] 


2.35 (0.69-7.98) 




77 (58-90) 


[23/30] 


7.61 (3.31-17.50) 




Time to discharge (d)" 1 ' 


















<4 


2.8 (2.0-3.9) 


[35/1,237] 


1 (Reference) 




12.0(10.2-14.0) 


[144/1,202] 


1 (Reference) 




>4 


5.6(4.3-7.1) 


[59/1 ,060] 


2.04 (1.33-3.12) 




54.2(51.1-57.4) 


[543/1,001] 


8.56(6.81-10.76) 




Site annual appendectomy volume** 
















<240 


4.4 (3.3-5.7) 


[49/1,119] 


1.31 (0.72-2.37) 


1.28(0.86-1.93) 


32.6 (29.8-35.5) 


[349/1 ,070] 


1.29 (0.65-2.56) 


1.22(0.60-2.49) 


>240 


3.7 (2.7-5.0) 


[45/1,201] 


1 (Reference) 


1 (Reference) 


31.2(28.6-34.0) 


[361/1,156] 


1 (Reference) 


1 (Reference) 



364/1 ,447] 1 (Reference) 1 (Reference) 

346/779] 2.42(2.00-2.92) 2.40(1.96-2.94) 

411/1,189] 1.28(1.07-1.53) 1.31 (1.08-1.59) 

299/1,037] 1 (Reference) 1 (Reference) 

152/657] 1 (Reference) 

558/1,569] 1.83(1.48-2.25) 



46/158] 

458/1,481] 

166/478] 

26/81] 

14/28] 



0.95(0.67-1.36) 
1 (Reference) 
1.18 (0.95-1 .47) 
1.06(0.66-1.70) 
NA 



1.08 (0.74-1.57) 
1 (Reference) 
1.03(0.82-1.30) 
1.10(0.66-1.81) 
NA 



269/728] 1.34(1.11-1.62) 1.25 (1.02-1.54) 
441/1,498] 1 (Reference) 1 (Reference) 



667/2,079] 
40/139] 
3/6] 
0/2] 



1.18(0.81-1.72) 
1 (Reference) 
NA 
NA 



1.11 (0.74-1.66) 
1 (Reference) 
NA 
NA 



Ellipsis indicates that the variable was not tested in the multivariable analysis. *Does not include one case with a missing pathology report; 'Weight in kilograms divided by the 
square of the height in meters; *8:00 AM to 5:00 PM on working days; § Defined as the interval from the emergency department visit to the induction of anesthesia for appen- 
dectomy; "Defined as the interval from the emergency department visit until hospital discharge; 'Does not include 23 cases of interval appendectomy; "Number of patients in- 
cluded in the study. AOR, adjusted odds ratio; CI, confidence interval; CT, computed tomography; NA, not applicable or unable to calculate; OR, odds ratio. 



instead of CT was used as the initial imaging modality in every 
1,000 patients, there would be 44 additional negative appendec- 
tomies (risk difference, 4.4 [95% CI, 0-8.8] percentage points). 
56% (95% CI, 18%-77%) of negative appendectomies that oc- 
curred following initial ultrasonography were attributable to 
choosing ultrasonography instead of CT as the initial imaging 
modality (attributable fraction). 

With the very high imaging utilization rate and overwhelm- 
ing preference of CT to ultrasonography in our results, the use 
of ultrasonography instead of CT would be responsible for three 
additional negative appendectomies in every 1,000 patients in 
the study population (population attributable risk, 0.3 [95% CI, 
0-0.6] percentage points). Similarly, it would be responsible for 
8% (95% CI, 0%-15%) of all negative appendectomies in the study 



population (population attributable fraction). 
Appendiceal perforation rate 

The overall appendiceal perforation rate was 31.9% (95% CI, 
30.0%-33.9%; 710/2,226). The appendiceal perforation rate at 
each step of the imaging work- up is detailed in Fig. 1 Appendi- 
ceal perforation rates for individual sites and the overall appen- 
diceal perforation rate adjusted for clustering by site are avail- 
able in Appendix Table 6. The appendiceal perforation rate was 
particularly low in patients who underwent CT and then com- 
plementary ultrasonography (7% [95% CI, l%-24%]). 

Higher appendiceal perforation rates were associated with 
older age, male gender, presentation during working hours, mode 
of surgical approach, and longer hospitalization in the univari- 
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able analysis; and with older age (AOR, 2.40; 95% CI, 1.96-2.94; 
P < 0.001), male gender (AOR, 1.31; 95% CI, 1.08-1.59; P = 0.006), 
and presentation during working hours (AOR, 1.25; 95% CI, 1.02- 
1 .54; P = 0.030) in the multivariable analysis (Table 4). The choice 
between CT and ultrasonography as the initial imaging modali- 
ty was not significandy associated with appendiceal perforation 
in univariable (odds ratio, 1.18; 95% CI, 0.81-1.72) or multivari- 
able (AOR, 1.11; 95% CI, 0.74-1.66) analysis. 

Diagnostic sensitivities of imaging modalities 

With the indeterminate results counted as positives and negati- 
ves, the respective sensitivities were 96.4% (95% CI, 95.5%-97.2%) 
and 94.0% (95% CI, 92.8%-95.0%; 1,858/1,977) for CT as the ini- 
tial imaging modality, and 100% (95% CI, 95%-100%) and 92% 
(95% CI, 84%-97%; 70/76) for ultrasonography as the initial im- 
aging modality, respectively (Fig. 1). The sensitivities for indi- 
vidual sites and overall sensitivities adjusted for clustering by 
site are available in Appendix Table 7. The subgroup analysis 
results are available in Appendix Table 8. 

DISCUSSION 

We attempted to capture an overview of diagnostic imaging 
pathways and clinical outcomes in patients undergoing appen- 
dectomy in one of the most densely populated areas in the world 
(28). The imaging utilization rate was 99.7%, indicating that vir- 
tually all patients undergoing appendectomy underwent pre- 
operative imaging tests, regardless of whether they had typical 
or equivocal presentations. The rate appears slightly higher than 
those in 2006-2011 reported from the United States (ranging 
from 93% to 98%) (1, 3-5). The minor difference maybe associ- 
ated with regional differences in reimbursement system and 
incidences of alternative diagnoses (8, 9), in addition to our in- 
clusion of outside imaging tests, of which consideration was 
unclear in previous studies (1, 3, 5). 

In our results, CT was used as much as 1 5 times more frequent- 
ly than ultrasonography as the initial imaging modality, com- 
parable to the ratio in the multi-institutional study from Wash- 
ington State (91% vs. 9%) (2). The overwhelming preference for 
CT over ultrasonography may be common in other developed 
countries. CT performed with modern machines outperforms 
ultrasonography in terms of rapidity, diagnostic accuracy, and 
provision of alternative diagnoses (10, 29, 30). 

The overall NAR was 4.1%, comparable to those in 2006-2007 
from leading academic centers in the United States (ranging 
from 1.7% to 7.1%) (1, 4, 5) and that in 201 1 in Washington State 
(approximately 4.5%) (3). Importantly, our multivariable analy- 
sis revealed that the use of CT instead of ultrasonography as the 
initial imaging modality significandy decreased NAR. The simi- 
lar trend can be found in the data from the Washington State 
study (3), although no formal comparison was made in that 



study. The NARs according to different diagnostic imaging path- 
ways in our results (Fig. 1) also imply that the use of CT, whether 
as an initial or complementary modality, is a strong deteiminant 
of a lower NAR. 

Nevertheless, we are not claiming additional increase of CT 
utilization. Despite the considerable risk difference and attrib- 
utable fraction, additional CT utilization would only marginally 
decrease the NAR further in the population, because virtually 
all patients are already undergoing preoperative imaging and 
CT is overwhelmingly preferred to ultrasonography. Had all pa- 
tients undergone initial CT, only three negative appendecto- 
mies for every 1,000 patients, or 8% of all negative appendecto- 
mies, would be additionally avoided from the status quo in the 
study population. This minute reduction in the NAR may not be 
meaningful, as the NAR we observed was already as low as 4. 1%, 
considerably lower than reported historically (1, 3-5). We be- 
lieve our observation can be generalized to other areas having 
high CT utilization rates similar to ours. In contrast, areas where 
CT is currently underutilized may have a greater margin for the 
NAR reduction by means of increased utilization of CT. 

On the other hand, concerns should be noted rather regard- 
ing the CT radiation. The typical effective doses at the sites of- 
ten exceeded the reference doses frequentiy quoted for abdo- 
men and pelvis CT (7-10 mSv) (31-33). This discrepancy may 
be common in many CT applications besides appendicitis (34). 
The typical effective dose exceeded 10 mSv or even 20 mSv at 
some sites, being close to the range where epidemiologic evi- 
dences exist for significant carcinogenic risk (35, 36). Even at 
the lowest typical dose across the sites (8 mSv), exposure at the 
age of 30 yr has been estimated to result in a lifetime excess risk 
of 63 and 72 cancers per 100,000 male and female patients, re- 
spectively (9, 37). More than 40,000 and 250,000 appendecto- 
mies are performed annually in metropolitan Seoul (19) and in 
the United States (38), respectively. Very high CT utilization rates 
and even greater numbers of CT examinations performed in 
patients who do not finally undergo appendectomy (9, 39) may 
imply real occurrence of cancer in the future in the populations 
having normal life expectancy. 

Therefore, it is now necessary to consider the radiation dose, 
in addition to the CT utilization rate and NAR, as an index of 
quality of care. Hopefully, a diagnostic guideline should be es- 
tablished to determine which patients do not need CT. Efforts 
are needed to optimize and standardize CT imaging protocols 
across hospitals by discarding unnecessary scan phases (40) 
and disseminating low-dose CT techniques (9). 

Although we observed comparable diagnostic sensitivities 
between CT and ultrasonography, our results need cautious in- 
terpretation. A considerable number of cases with unavailable 
reports were not included in the sensitivity calculations. Ultra- 
sonography was used relatively more in subgroups that were 
more amenable to ultrasonography, who were younger female 
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or presented in working hours. In general, CT is known to be 
better than ultrasonography in terms of diagnostic performance 
(14, 15). 

Our study had limitations. First, our site recruitment relied 
on voluntary participation, limiting study generalizability. The 
participating sites potentially had greater study motivation and 
more extensive hospital resources than did hospitals not par- 
ticipating. Second, as a limited number of patients underwent 
initial ultrasonography, we were unable to explore in which pa- 
tients ultrasonography instead of CT would suffice as the initial 
imaging modality. Likewise, we were unable to explore which 
patients do not even require any imaging examination. Third, 
as our study sample consisted of patients who underwent ap- 
pendectomy, we were unable to measure the overall imaging 
utilization pattern in patients having suspected appendicitis. 
Fourth, we did not analyze alternative diagnoses, as it was un- 
feasible to form reasonable reference standards in many diag- 
nosis categories. 

We observed a very high CT utilization rate and a low NAR in 
metropolitan Seoul, similar to those recently reported from the 
United States. In these areas, CT utilization seems to have rea- 
ched the level that further increase of CT utilization would not 
meaningfully reduce the NAR. Efforts now need to be directed 
to optimize and standardize CT imaging protocols and to re- 
duce radiation dose. 
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